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ABSTRACT 



Image fusion may be used to combine images from different sensors, such as IR and 
visible cameras, to obtain a single composite with extended information content. Fusion 
may also be used to combine multiple images from a given sensor to form a composite 
image in which information of interest is enhanced. 

We present a general method for performing image fusion and show that this method is 
effective for diverse fusion applications. We suggest that fusion may provide a powerful 
tool for enhanced image capture with broad utility in image processing and computer 
vision. 
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The Fusion Task 


Changing Illumination 
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Image Fusion: Objectives 


Combine two or more source images to obtain a single 
composite with extended information content. 



Visible 




Fused 


Requirements 

• retain all useful information from the source images 

• not introduce fusion artifacts into the combined image 

• look "natural" 
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Technical Challenge 


Pixel averaging, results in ... 
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Technical Challenge 


Pixel averaging, results in ... 



2. Double 
Exposure 
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Pixel-Based Approach 



• each output pixel is computed separately 

• based on the corresponding source image 
pixels 

• or neighborhoods of corresponding pixels 
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Pattern-Selective Approach 



• copy a pattern at a time 

• select most salient patterns only 
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Composite Imaging 
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Pyramid-Based Fusion: 
Some History... 
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Burt 

model of human binocular 
vision 
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multi-focus 
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IR and visual images 

1991 
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Tinkler 

Tl method 
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Laplacian Pyramid Transform 
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Gradient Pyramid Framework for 

Image Fusion 
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Scaled Grad t end Operafe r S 
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Gradient Pyramid Transform 
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Gaussian Gradient Oriented FSD RE Gaussian 

Laplacian Laplacian Laplacian Reconstructed 



















Multi-focus example of gradient pyramid fusion. ( a and b ) Source images obtained with a 
camera lens set to focus at different distances, (c) The fused image has an extended depth 
of field. 
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Multi-exposure example of gradient pyramid fusion. ( a and b ) Source images obtained 
with different camera exposure settings to observe patterns in shaded regions (a) and 
bright, sun-lit regions (b). (c) The fused image includes detail from both regions. ( d ) 
Pyramid samples values are normalized and quantized to just 4 bits to demonstrate that a 
broad dynamic range scene can be represented by a narrow dynamic range signal without 
loss of critical detail. 
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A multi-sensor example of gradient pyramid fusion, (a and b ) Source images were obtained 
from a visible light camera (a) and an infrared camera ( b ). (c) The fused image includes details 
from both sources. 


Summary 


• Enhance image capture by combining 
observations 


• Combine to preserve contrast 
(max gradient) 

• Gradient pyramid framework 
(multiscale) 

• Deliberately limit each observation 
(narrow band) 
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